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(57) A moving picture coding apparatus (1) in- 
cludes: a map creation unit (113) for creating variable 
speed reproduction information Map that is information 
necessary for variable speed reproduction according to 
a picture type Ptype; a variable length coding unit (112) 
for coding the variable speed reproduction information 
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(114) for detecting the need of coding a picture param- 
eter set PPS referred to by a current picture to be coded; 
and a common information addition unit (1 15) for adding 
the picture parameter set PPS to the current picture to 
be coded when the detection unit (114) detects the need 
of coding the picture parameter set PPS. 
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Description 
Technical Field 

[0001] The present invention relates to a moving pic- 
ture coding method for coding moving pictures so as to 
reproduce them at variable speed, a moving picture de- 
coding method for decoding a stream which has been 
so coded generated by such coding, and the stream. 

Background Art 

[0002] In the age of multimedia which integrally han- 
dles audio, video and other pixel values, existing infor- 
mation media, i.e., newspapers, magazines, televi- 
sions, radios, telephones and other means through 
which information is conveyed to people, have recently 
come to be included in the scope of multimedia. Gener- 
ally, multimedia refers to something that is represented 
by associating not only characters but also graphics, 
voices, and especially pictures and the like together, but 
in order to include the aforementioned existing informa- 
tion media in the scope of multimedia, it appears as a 
prerequisite to represent such information in digital 
form. 

[0003] However, when calculating the amount of in- 
formation contained in each of the aforementioned in- 
formation media as the amount of digital information, 
while the amount of information per character is 1-2 
bytes, the amount of information to be required for voice 
is 64Kbits or over per second (telephone quality), and 
100Mbits or over per second for moving pictures (cur- 
rent television reception quality), and thus it is not real- 
istic forthe aforementioned information media to handle 
such an enormous amount of information as it is in digital 
form. For example, although videophones are already 
in the actual use via Integrated Services Digital Network 
(ISDN) which offers a transmission speed of 64Kbps/ 
s~1 .5Mbps/s, it is not practical to transmit video shot by 
television cameras directly through ISDN. 
[0004] Against this backdrop, information compres- 
sion techniques have become necessary, and moving 
picture compression techniques compliant with H.261 
and H.263 standards suggested by ITU-T (International 
Telecommunication Union - Telecommunication Stand- 
ardization Sector) are employed for videophones, for 
example. Moreover, according to information compres- 
sion techniques compliant with the MPEG-1 standard, 
it is possible to store picture information in an ordinary 
music CD (compact disc) together with sound informa- 
tion. 

[0005] Here, MPEG (Moving Picture Experts Group) 
is an international standard on compression of moving 
picture signals standardized by ISO/IEC (International 
Standards Organization/International Electrotechnical 
Commission), and MPEG-1 is a standard for compress- 
ing moving picture signals, namely, television signal in- 
formation, approximately into one hundredth. Further- 



more, since MPEG-1 targets for moderate picture qual- 
ity which can be realized by a transmission speed of 
about 1 .5Mbps, MPEG-2, which was standardized with 
a view to satisfy requirements for further improved pic- 
5 ture quality, allows data transmission of moving picture 
signals at a rate of 2-1 5Mbps so as to realize TV broad- 
casting quality. 

[0006] Under the present situation, MPEG-4 that 
achieves a highercompression ratio than that of MPEG- 

10 1 and MPEG-2, allows coding, decoding and operation 
in the unit of an object, and realizes new functions re- 
quired for the multimedia age, has been standardized 
by the working group (ISO/IEC JTC1/SC29/WG11) 
which has been engaged in the standardization of 

15 MPEG-1 and MPEG-2. MPEG-4 was initially aimed at 
standardization of a coding method for a low bit rate, but 
now it is extended to standardization of a more versatile 
coding method further including interlaced images and 
higher bit rates. Furthermore, ISO/IEC and ITU-T are 

20 now jointly making efforts to standardize MPEG-4 AVC 
and ITU H.264 as a next-generation picture coding 
method that allows a still higher compression ratio. As 
of May 2002, a next-generation picture coding method 
called Committee Draft (CD) has been issued (See Text 

25 of Committee Draft of Joint Video Specification (ITU-T 
Rec. H.264 I ISO/IEC 14496-10 AVC) 0.4 'Overview of 
the syntax' 0.4.1 'Temporal processing' 8.2.2 'Parameter 
set decoding', for example). 

[0007] Generally in the moving picture coding, the 

30 amount of information is compressed by reducing re- 
dundancies in the spatial and temporal directions. In the 
inter picture prediction coding for reducing the temporal 
redundancies, motion of a current picture is estimated 
and its predictive picture is obtained on a block-by-block 

35 basis with reference to a temporarily forward or back- 
ward picture, and the difference between the predictive 
picture and the current picture is coded. Here, the term 
"picture" represents a single sheet of an image, and it 
represents a frame when used in a context of a progres- 

40 sive image, whereas it represents a frame or a field in 
a context of an interlaced image. The interlaced image 
here is an image corresponding to a single frame that is 
made up of two fields having differenttimes respectively. 
In the process of coding and decoding the interlaced im- 

45 age, a single frame can be handled as a frame itself, as 
two fields, or as a frame structure or a field structure on 
every block in the frame. 

[0008] Apicture which is intra picture prediction coded 
with reference to no picture is called an l-picture. A pic- 

50 ture which is inter picture prediction coded with refer- 
ence to only one picture is called a P-picture. And a pic- 
ture which is inter picture prediction coded with refer- 
ence to two pictures at the same time is called a B-pic- 
ture. AB-picture can be coded with reference to two pic- 

55 tures of arbitrary combinations of preceding and subse- 
quent pictures in display order. Reference pictures can 
be specified on every blockthat is a basic unitforcoding 
and decoding, but distinction is made between a first ref- 
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erence picture that is described earlier in a bit stream 
obtained by coding and a second reference picture that 
is described later there. These reference pictures must 
have been already coded and decoded for coding and 
decoding above-mentioned pictures. 
[0009] Motion compensation inter picture prediction 
coding is used for coding P-pictures and B-pictures. Mo- 
tion compensation inter picture prediction coding is a 
coding method by inter picture prediction coding to 
which motion compensation is applied. Motion compen- 
sation is a methodfor improving prediction accuracy and 
reducing an amount of data by estimating an amount of 
motion (hereinafter referred to as a motion vector) of 
each region in a picture and performing prediction in 
consideration of the estimated motion, not performing 
prediction just based on pixel values of reference pic- 
tures. For example, an amount of data is reduced by 
estimating a motion vector of a current picture to be cod- 
ed and coding a prediction error between the current pic- 
ture and a predictive picture that is obtained by shifting 
the current picture by an amount of that motion vector. 
Sincethis method requires motion vector information for 
decoding, the motion vector is also coded and recorded 
or transmitted. 

[0010] A motion vector is estimated per macroblock 
or block. To be more specific, a motion vector is estimat- 
ed by fixing a macroblock or a block in a current picture 
to be coded, moving a macroblock or a block in a refer- 
ence picture within a search range and then estimating 
a location of the reference macroblock or blork which is 
most similar to the fixed macroblock or block. 
[0011] FIG. 1 A and FIG. 1 B are structure diagrams of 
a conventional MPEG-2 stream, and more specifically, 
FIG. 1A shows a sequence of pictures and FIG. 1B 
shows a hierarchical structure of a stream. As shown in 
FIGs. 1 A and 1 B, an MPEG-2 stream has the following 
hierarchical structure. A stream is made up of a plurality 
of groups of pictures (GOPs), and editing of and random 
access to a moving picture can be done based on this 
GOP as a basic unit for coding processing. A group of 
pictures is made up of a plurality of pictures, namely, I- 
pictures, P-pictures or B-pictures. Each of a stream, a 
GOP and a picture as a unit includes a synchronizing 
signal (sync) indicating a separation of each unit and a 
header that is data common to the unit. 
[0012] FIG. 2 is a diagram showing another hierarchi- 
cal structure of a conventional stream. This stream cor- 
responds to a stream for JVT (H.264/MPEG-4 AVC) 
which is now being developed jointly by ITU-T and ISO/ 
I EC forstandardization. JVT has no concept of a header, 
and common data called a parameter set PS is placed 
at the head of the stream. Also, JVT has no concept of 
a GOP but a random-accessible unit that corresponds 
to a GOP can be structured by dividing data per special 
unit of pictures that can be decoded independent of oth- 
er pictures. This unit is referred to as a random access 
unit RAU. 

[0013] There are two types of a parameter set PS: a 



picture parameter set PPS that is data corresponding to 
a header of each picture; and a sequence parameter set 
SPS corresponding to a header of each GOP or se- 
quence of MPEG-2. Each picture is assigned an identi- 

5 fier indicating which one of a plurality of candidate pic- 
ture parameter sets PPSs and sequence parameter 
sets SPSs the picture is to refer to. To be more specific, 
a plurality of sets of PPSs and SPSs are coded only 
once and an identifier indicates which one of the sets 

10 each picture is to refer to, and thus it is possible to omit 
waste of coding a header (or a parameter set) of the 
same value repeatedly in each picture of MPEG-2, so 
as to improve a compression ratio. 
[0014] A picture number PN is an identification 

15 number for identifying a picture. A sequence parameter 
set SPS includes the maximum number of reference pic- 
tures, a picture size and others, and a picture parameter 
set PPS includes a type of variable length coding (Huff- 
man coding and arithmetic coding are switched), an in- 

20 itial value for a quantization step, the number of refer- 
ence pictures and others. 

[0015] FIG. 3 is a block diagram showing a structure 
of a moving picture coding apparatus that realizes a con- 
ventional moving picture coding method. 

25 [0016] A moving picture coding apparatus 3 is an ap- 
paratus for compressing and coding an inputted picture 
(image) signal Vin and outputting an bit stream Str ob- 
tained by transformation such as variable length coding, 
and includes a motion estimation unit 101, a motion 

30 compensation unit 102, a subtraction unit 103, an or- 
thogonal transformation unit 104, a quantization unit 
1 05, an inverse quantization unit 1 06, an inverse orthog- 
onal transformation unit 1 07, an addition unit 1 08, a pic- 
ture memory 109, a switch 110, a prediction structure 

35 determination unit 1 1 1 and a variable length coding unit 
301. 

[0017] The image signal Vin is inputted to the subtrac- 
tion unit 103 and the motion estimation unit 101. The 
subtraction unit 103 calculates a differential value be- 

40 tween the inputted image signal Vin and a predictive im- 
age and outputs it to the orthogonal transformation unit 
1 04. The orthogonal transformation unit 1 04 transforms 
the differential value into a frequency coefficient and 
outputs it to the quantization unit 105. The quantization 

45 unit 105 quantizes the inputted frequency coefficient 
and outputs a quantized value Qcoef to the variable 
length coding unit 301 . 

[0018] The inverse quantization unit 106 inverse- 
quantizes the quantized value Qcoef to reconstruct it as 

50 the frequency coefficient and outputs it to the inverse 
orthogonal transformation unit 1 07. The inverse orthog- 
onal transformation unit 107 performs inverse frequency 
transformation on the frequency coefficient into a pixel 
differential value and outputs it to the addition unit 1 08. 

55 The addition unit 108 adds the pixel differential value 
and the predictive image outputted from the motion 
compensation unit 102 so as to be a decoded image. 
The switch 110 turns ON when it is instructed to store 
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the decoded image (picture), and the decoded picture 
is stored in the picture memory 109. 
[0019] On the other hand, upon receipt of the image 
signal Vin per macroblock, the motion estimation unit 
1 01 searches the decoded pictures stored in the picture 
memory 109 to estimate an image area which is most 
similar to the inputted image signal and determines a 
motion vector MV pointing the location of the image ar- 
ea. Motion vectors are estimated per block which is a 
unit smaller than a macroblock. Since a plurality of pic- 
tures can be used as reference pictures for that purpose, 
an identification number (a reference index Index) for 
specifying a reference picture is needed for each block. 
It is possible to specify a reference picture by the refer- 
ence index Index indicating correspondence between a 
picture number of each picture in the picture memory 
109 and its reference picture. 

[0020] The motion compensation unit 1 02 extracts an 
image area which is most suitable for a predictive image 
from decoded pictures stored in the picture memory 1 09 
using the motion vector MV and the reference index In- 
dex estimated by the above processing. 
[0021] If a current picture is a random access unit start 
picture RAUin indicating the start position of a random 
access unit RAU, the prediction structure determination 
unit 1 1 1 instructs the motion estimation unit 1 01 and the 
motion compensation unit 102 to code (perform intra 
picture coding on) the current picture as a special picture 
that can be random accessed, depending on its picture 
type Ptype. And the prediction structure determination 
unit 111 outputs the picture type Ptype to the variable 
length coding unit 301 . 

[0022] The variable length coding unit 301 performs 
variable length coding on the quantized values Qcoef, 
the reference indices Index, the picture types Ptype and 
the motion vectors MV so as to be a bit stream Str. 
[0023] FIG. 4 is a block diagram showing a structure 
of a moving picture decoding apparatus that realizes a 
conventional moving picture decoding method. In this 
figure, the same reference numbers are assigned to the 
units that operate in the same manner as the moving 
picture coding apparatus that realizes the conventional 
moving picture coding method as shown in FIG. 3, and 
the explanation thereof is omitted. 
[0024] The variable length decoding unit 401 decodes 
a bit stream Str and outputs quantized values Qcoef, 
reference indices Index, picture types Ptype and motion 
vectors MV. The quantized values Qcoef the reference 
indices Index and the motion vectors MV are inputted to 
the picture memory 208, the motion compensation unit 
204 and the inverse quantization unit 205 and decoded, 
and the operation of the decoding is same as that per- 
formed by the conventional moving picture coding ap- 
paratus as shown in FIG. 3. 

[0025] However, decoding can be performed using 
only the pictures in the random access unit RAU itself, 
but information for variable speed reproduction, which 
is important for a storage apparatus such as a VTR and 



a disc recorder, cannot be obtained using the conven- 
tional JVT coding method and its stream. This is be- 
cause JVT has introduced a very flexible inter picture 
prediction structure in orderto improve coding efficiency 

5 (compression ratio) substantially. 

[0026] FIG. 5A and FIG. 5B are schematic diagrams 
showing examples of reference relationships between 
pictures. FIG. 5A is a prediction structure between pic- 
tures used in MPEG-2. Diagonally shaded pictures in 

10 this diagram are referred to other pictures. In MPEG-2, 
P-pictures (P4 and P7) can be predictively coded with 
reference to only one l-picture or P-picture immediately 
preceding in display order. B-pictures (B1 , B2, B3, B5 
and B6) can be predictively coded with reference to one 

15 |-picture or P-picture immediately preceding in display 
order and one l-picture or P-picture immediately subse- 
quent in display order. In addition, the order in which 
pictures are arranged in a stream is determined, and I- 
pictures and P-pictures are arranged in display order, 

20 while B-pictures are arranged immediately subsequent 
to l-pictures or P-pictures which are to be displayed im- 
mediately after the B-pictures. As a result, the following 
three types of decoding can be performed: i) decoding 
of all the pictures; ii) decoding of only the streams of I- 

25 pictures and P-pictures for display of only the l-pictures 
and the P-pictures; and iii) decoding of only the streams 
of l-pictures for display. Therefore, three types of high- 
speed reproduction can be realized easily: i) normal- 
speed reproduction; ii) medium-speed reproduction; 

30 and iii) high-speed reproduction. 

[0027] In JVT, B-pictures can also be predictively cod- 
ed with reference to B-pictures. FIG. 5B shows an ex- 
ample of prediction in JVT, where B-pictures (B1 and 
B3) refer to a B-picture (B2). In this example, thefollow- 

35 ing four types of decoding can be realized: i) decoding 
of all the pictures; ii) decoding of only the streams of 
reference l-pictures, P-pictures and B-pictures for dis- 
play; iii) decoding of only the streams of l-pictures and 
P-pictures for display of only the l-pictures and the P- 

40 pictures; iv) decoding of only the streams of l-pictures 
for display. 

[0028] Furthermore, P-pictures can referto B-pictures 
in JVT, and a P-picture (P7) can referto a B-picture (B2) 
as shown in FIG. 6. In this case, since the P-picture (P7) 

45 cannot be decoded unless the B-picture (B2) has not 
yet been decoded, the following three types of decoding 
can be realized: i) decoding of all the pictures; ii) decod- 
ing of only the streams of reference l-pictures, P-pic- 
tures and B-pictures for display; and iii) decoding of the 

50 streams of l-pictures for display. 

[0029] As mentioned above, since JVT accepts a very 
flexible prediction structure, it is not known what kind of 
variable speed reproduction can be realized unless an 
actual prediction structure is unknown. Therefore, only 

55 the following two types of decoding, at most, can be re- 
alized independent of the prediction structure in view of 
the examples in FIGs. 5A, 5B and 6: i) decoding of all 
the pictures; and ii) decoding of only the streams of I- 
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pictures for display. These are too few choices, com- 
pared with the number of variable speed reproductions 
realized by MPEG-2. 

[0030] The present invention has been conceived in 
view of the above circumstances, and aims at providing 
a moving picture coding method, a moving picture de- 
coding method and the like by which pictures which 
need to be decoded for variable speed reproduction can 
be easily specified and coding and decoding suitable for 
variable speed reproduction can be performed. 

Disclosure of Invention 

[0031] In order to achieve this object, the moving pic- 
ture coding method according to the present invention 
is a moving picture coding method for coding a moving 
picture signal on a picture-by-picture basis and gener- 
ating a bit stream, comprising: an information creation 
step of creating variable speed reproduction information 
for specifying pictures to be reproduced at variable 
speed; and a coding step of coding the variable speed 
reproduction information and adding said information to 
the bit stream. 

[0032] Accordingly, since pictures which are to be re- 
produced at a desired variable speed can be specified 
based on variable speed reproduction information when 
the variable speed reproduction is performed, and thus, 
by decoding only the specified pictures, the variable 
speed reproduction can be realized easily without de- 
coding unnecessary pictures. 

[0033] Here, in the information creation step, the var- 
iable speed reproduction information may be created for 
each random access unit that is made up of a plurality 
of pictures, said random access unit being a unit in 
which a current picture to be decoded can be decoded 
with reference to another picture only in the random ac- 
cess unit. 

[0034] Accordingly, pictures which are to be repro- 
duced at a desired variable speed can be specified 
based on the variable speed reproduction information 
when the variable speed reproduction is performed, 
even if a reference structure between the pictures in 
each random access unit differs from each other. 
[0035] The above-mentioned moving picture coding 
method may further comprise a detection step of detect- 
ing whether common information needs to be coded or 
not, said common information being referred to by the 
pictures to be reproduced at variable speed; and a com- 
mon information addition step of adding the common in- 
formation to the pictures when it is detected in the de- 
tection step that said information needs to be coded. 
[0036] Accordingly, even if common information has 
already been added to pictures which are to be repro- 
duced at slower than N times speed, the common infor- 
mation can also always be added to pictures which are 
to be reproduced at N times speed if the pictures require 
the common information. Therefore, it is possible to 
avoid the situation in which there is no common infor- 



mation to be referred to when the variable speed repro- 
duction is performed. 

[0037] Also, the moving picture decoding method ac- 
cording to the present invention is a moving picture de- 

5 coding method for decoding a bit stream on a picture- 
by-picture basis, comprising: an information extraction 
step of extracting variable speed reproduction informa- 
tion for specifying pictures to be reproduced at variable 
speed; and a decoding step of decoding the variable 

10 speed reproduction information and specifying and de- 
coding the pictures to be reproduced at variable speed 
based on the variable speed reproduction information. 
[0038] Accordingly, pictures which are to be repro- 
duced at a desired variable speed can be specified 

15 based on the variable speed reproduction information 
when the variable speed reproduction is performed, and 
thus, by decoding only the specified pictures, the varia- 
ble speed reproduction can be realized easily without 
decoding unnecessary pictures. 

20 [0039] Here, in the information extraction step, the 
variable speed reproduction information may be extract- 
ed from each random access unit that is made up of a 
plurality of pictures, said random access unit being a unit 
in which a current picture to be decoded can be decoded 

25 with reference to another picture only in the random ac- 
cess unit. 

[0040] Accordingly, pictures which are to be repro- 
duced at a desired variable speed can be specified 
based on the variable speed reproduction information 

30 when the variable speed reproduction is performed, 
even if a reference structure between the pictures in 
each random access unit differs from each other. 
[0041] In addition, the above-mentioned moving pic- 
ture decoding method may further comprise a memory 

35 control step of controlling a picture on the assumption 
that the picture is stored in a picture memory when the 
reproduction is performed at variable speed, said pic- 
ture being not to be reproduced at variable speed but 
referred to by another picture. 

40 [0042] Accordingly, even if a reference picture is 
specified relatively, it can be avoided that the picture 
specified as a reference picture for a current picture to 
be decoded for variable speed reproduction differs from 
a reference picture used for the current picture when it 

45 has been coded. 

[0043] The present invention can be realized not only 
as the above-mentioned moving picture coding method 
and moving picture decoding method, but also as a mov- 
ing picture coding apparatus and a moving picture de- 

50 coding apparatus including, as units, characteristic 
steps included in these moving picture coding method 
and moving picture decoding method. Or, the present 
invention can be realized as a program causing a com- 
puter to execute those steps, or as a bit stream obtained 

55 by coding using the moving picture coding method. It is 
needless to say that the program and the bit stream can 
be distributed via a recording medium such as a 
CD-ROM and a transmission medium such as the Inter- 
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net. 

[0044] As described above, the moving picture coding 
method and the moving picture decoding method ac- 
cording to the present invention allows easy specifica- 
tion of pictures which need to be decoded for variable 5 
speed reproduction in a random access unit RAU, so 
coding and decoding suitable for the variable speed re- 
production can be easily realized, and thus its practical 
value is extremely high. 

w 

Brief Description of Drawings 
[0045] 

FIG. 1A and FIG. 1B are structure diagrams of a 15 
conventional MPEG-2 stream, and more specifical- 
ly, FIG. 1 A shows a sequence of pictures and FIG. 
1 B shows a hierarchical structure of the stream. 
FIG. 2 is a diagram showing a hierarchical structure 
of another conventional stream. 20 
FIG. 3 is a block diagram showing a structure of a 
moving picture coding apparatus that realizes a 
conventional moving picture coding method. 
FIG. 4 is a block diagram showing a structure of a 
moving picture decoding apparatus that realizes a 25 
conventional moving picture decoding method. 
FIG. 5A and FIG. 5B are schematic diagrams show- 
ing examples of reference relationships between 
pictures, and more specifically, FIG. 5A is an exam- 
ple of inter picture prediction structure of MPEG-2 30 
and FIG. 5B is an example of prediction structure 
of JVT. 

FIG. 6 is a schematic diagram showing an example 
of reference relationship between pictures. 
FIG. 7 is a block diagram showing a structure of a 35 
moving picture coding apparatus that realizes a 
moving picture coding method according to the 
present invention. 

FIG. 8A- FIG. 8D are structure diagrams of streams 
(in a first embodiment) of the present invention, and 40 
more specifically, FIG. 8A is an example of a struc- 
ture of a random access unit RAU, FIG. 8B is an 
example of a variable speed reproduction map 
RAM, FIG. 8C is another example of the variable 
speed reproduction map RAM, and FIG. 8D is still 45 
another example of thevariable speed reproduction 
map RAM. 

FIG. 9A - FIG. 9C are schematic diagrams showing 
examples of reference relationships between pic- 
tures (in the first embodiment), and more specifical- 50 
ly, FIG. 9A is an example of reference relationship 
between pictures, FIG. 9B is another example of 
reference relationship between pictures, and FIG. 
9C is still another example of reference relationship 
between pictures. 55 
FIG. 1 0 is a flowchart showing an operation for cre- 
ating a variable speed reproduction map RAM. 
FIG. 11 is a flowchart showing an operation for add- 



ing a picture parameter set PPS. 
FIG. 12 is a flowchart showing an operation for cod- 
ing a current picture. 

FIG. 13Aand FIG. 13B are diagrams of a structure 
of a stream (in a second embodiment) of the present 
invention, and more specifically, FIG. 13A is an ex- 
ample of a structure of a random access unit RAU 
and FIG. 1 3B is an example of a variable speed re- 
production map table RAMTBL. 
FIG. 14 is a flowchart showing an operation for cre- 
ating a variable speed reproduction map identifier 
RAMID. 

FIG. 15 is a block diagram showing a structure of a 
moving picture decoding apparatus that realizes a 
moving picture decoding method of the present in- 
vention. 

FIG. 1 6A and FIG. 1 6B are flowcharts showing op- 
erations of the moving picture decoding apparatus, 
and more specifically, FIG. 16A is a flowchart show- 
ing an operation for the structure of the stream as 
shown in the first embodiment and FIG. 16B is a 
flowchart showing an operation for the structure of 
the stream as shown in the second embodiment. 
FIG. 1 7A - FIG. 1 7C are schematic diagrams show- 
ing how a picture memory stores pictures, and more 
specifically, FIG. 1 7A shows the stored pictures for 
normal speed reproduction, FIG. 17B shows the 
stored pictures for conventional quad-speed repro- 
duction, and FIG. 17C shows the stored pictures for 
quad-speed reproduction of the present invention. 
FIG. 1 8 is a flowchart showing an operation for de- 
coding a current picture. 

FIG. 1 9A and FIG. 1 9B are flowcharts showing oth- 
er operations of the moving picture decoding appa- 
ratus, and more specifically, FIG. 19A is a flowchart 
showing an operation for the structure of the stream 
as shown in the first embodiment and FIG. 1 9B is a 
flowchart showing an operation for the structure of 
the stream as shown in the second embodiment. 
FIG. 20A - FIG. 20C are illustrations of a recording 
medium for storing a program for realizing the mov- 
ing picture coding method and the moving picture 
decoding method in each of the embodiments using 
a computer system, and more specifically, FIG. 20A 
is an illustration showing a physical format of a flex- 
ible disk as a main unit of the recording medium, 
FIG. 20B is an illustration showing a front view of 
the appearance of a flexible disk, a cross-sectional 
view of the flexible disk and the flexible disk itself, 
and FIG. 20C is an illustration showing a configura- 
tion for recording and reproducing the above pro- 
gram on and from the flexible disk FD. 
Fig. 21 is a block diagram showing an overall con- 
figuration of a content supply system that realizes 
a content distribution service. 
Fig. 22 is a diagram showing an example of a mobile 
phone. 

Fig. 23 is a block diagram showing an internal struc- 
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ture of the mobile phone. 

Fig. 24 is a block diagram showing an overall con- 
figuration of a digital broadcasting system. 

Best Mode for Carrying Out the Invention 

[0046] Too flexible prediction structure of JVT makes 
variable speed reproduction difficult. So if it can be 
known which type of prediction structure has been used 
for pictures in a random access unit RAU before decod- 
ing the random access unit RAU, more than two types 
of variable speed reproduction can be realized, as 
shown in respective examples in FIG. 5A, FIG. 5B and 
FIG. 6. 

[0047] The embodiments of the present invention will 
be explained below with reference to FIG. 7 - FIG. 24. 
[0048] A random access unit RAU used for explana- 
tion in the embodiments does not necessarily need to 
be a special unit for JVT, but may be a set of pictures 
starting with an intra coded picture (l-picture) because 
a parameter set PS is placed in each random access 
unit RAU. 

(First Embodiment) 

[0049] FIG. 7 is a block diagram showing a structure 
of a moving picture coding apparatus in an embodiment 
using a moving picture coding method according to the 
present invention. Note that the same reference num- 
bers are assigned to the units that operate in the same 
manner as the units in the conventional moving picture 
coding apparatus 3 as shown in FIG. 3, and the expla- 
nation thereof is omitted. 

[0050] A moving picture coding apparatus 1 is an ap- 
paratus for compressing and coding an inputted picture 
signal Vin to transform it into a bit stream by performing 
variable length coding or the like, and outputting the bit 
stream Str, and includes the motion estimation unit 101 , 
the motion compensation unit 102, the subtraction unit 
103, the orthogonal transformation unit 104, the quan- 
tization unit 105, the inverse-quantization unit 106, the 
inverse orthogonal transformation unit 107, the addition 
unit 108, the picture memory 109, the switch 110, the 
prediction structure determination unit 111, the variable 
length coding unit 112, a map creation unit 113, a de- 
tection unit 114 and a common information addition unit 
115. 

[0051] The map creation unit 113 creates variable 
speed reproduction information Map necessary for var- 
iable speed reproduction (for example, a variable speed 
reproduction map RAM, a variable speed reproduction 
map table RAMTBL or a variable speed reproduction 
map identifier RAM ID to be described later) according 
to a picture type Ptype, and outputs it to the variable 
length coding unit 112. The variable length coding unit 
112 codes the variable speed reproduction information 
Map and places it into a bit stream Str. 
[0052] When a current picture to be coded is a picture 



to be reproduced (decoded) at N times or faster speed, 
the detection unit 114 judges whether or not a picture 
parameter set PPSthat is common information referred 
to by the current picture has already been coded when 
5 coding another picture to be reproduced at N times or 
faster speed, and detects the need of coding the picture 
parameter set PPS. The common information addition 
unit 1 1 5 adds the picture parameter set PPS to the cur- 
rent picture if the need of coding is detected by the de- 
10 tection unit 114. 

[0053] FIG. 8A - FIG. 8D are structure diagrams of 
streams in the first embodiment. This structure is differ- 
ent from that of the conventional stream in FIG. 2 in that 
a variable speed reproduction map RAM is placed in the 
15 random access unit RAU. 

[0054] FIG. 8A shows an example of the structure of 
the random access unit RAU. In this structure example, 
the variable speed reproduction map RAM is placed be- 
fore pictures in the random access unit RAU, and infor- 
mation indicating the stream of which picture needs to 
be decoded for desired variable speed reproduction is 
described in the variable speed reproduction map RAM. 
The moving picture decoding apparatus decodes only 
the pictures necessary for desired variable speed repro- 
duction according to the information described in the 
variable speed reproduction map RAM, and thus allows 
variablespeed reproduction easily without decoding un- 
necessary pictures. 

[0055] FIG. 8B is an example of the variable speed 
reproduction map RAM. Reproduction speed required 
for decoding a picture is described in the variable speed 
reproduction map RAM for each picture number that is 
a picture identifier in the random access unit RAU. In 
other words, information indicating reproduction speed 
required for decoding the picture (Speed) is described 
following each number of the picture PN. As a result, it 
can be known easily which picture needs to be decoded 
at a desired reproduction speed. Note that all the picture 
numbers PN may be placed together at the head of the 
random access unit RAU and all the information indicat- 
ing reproduction speed required for decoding (Speed) 
may be placed together following the picture numbers 
PN. 

[0056] FIG. 8C is another example of the variable 
speed reproduction map RAM. Reproduction speeds re- 
quired for decoding respective pictures in the random 
access unit RAU are described in sequence. As a result, 
picture numbers PN do not necessarily need to be 
placed in the variable speed reproduction map RAM, 
and thus space required for placing the picture numbers 
PN can be saved. 

[0057] FIG. 8D is still another example of the variable 
speed reproduction map RAM. The information indicat- 
ing reproduction speed required for decoding (Speed) 
is placed first, and following that, picture numbers PN of 
pictures necessary for reproduction at that speed is de- 
scribed. 

[0058] The information indicating reproduction speed 
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required for decoding (Speed) is described as "N" if it is 
described in that information that a picture M needs to 
be decoded at N times speed. In a case of N<K where 
the reproduction speed is K, the picture M does not need 
to be decoded, whereas it needs to be decoded in a case 
of N>=K. 

[0059] FIG. 9A - FIG. 9C are schematic diagrams 
showing examples of reference relationships between 
pictures. Here, the diagonally shaded pictures are re- 
ferred to by other pictures. 

[0060] In the example as shown in FIG. 9A, the pic- 
tures 10, P3 and P6 are reproduced at triple speed. In 
the example as shown in FIG. 9B, the pictures 10 and 
P4 are reproduced at quad speed, and the pictures 10, 
B2, P4 and B6 are reproduced at double speed. In the 
example as shown in FIG. 9C, the pictures 10, P3 and 
P6 are reproduced at triple speed, and the pictures 10, 
P1, P3, P4, P6 and P7 are reproduced at 1.5 times 
speed. 

[0061] Therefore, the information indicating reproduc- 
tion speed required for decoding (Speed) is "3" for the 
pictures 10, P3 and P6 and "1" for the other pictures in 
the example of FIG. 9A, "4" for the pictures 10 and P4, 
"2" for the pictures B2 and B6 and "1 " for the other pic- 
tures in the example of FIG. 9B, and "3" for the pictures 
10, P3 and P6, "1 .5" for the pictures P1 , P4 and P7 and 
"1" for the other pictures in the example of FIG. 9C. 
[0062] Next, the operation of the moving picture cod- 
ing apparatus 1 structured as mentioned above will be 
explained. FIG. 10 is a flowchart showing the operation 
for creating a variable speed reproduction map RAM. 
[0063] The map creation unit 113 judges whether or 
not a current picture to be coded is a picture at a random 
access point, namely, the first picture in the random ac- 
cess unit RAU (Step S1 0). If it is the picture at the ran- 
dom access point as a result of the judgment (YES in 
Step S10), the map creation unit 113 creates a variable 
speed reproduction map RAM and outputs it to the var- 
iable length coding unit 112 (Step S11). Next, the vari- 
able length coding unit 112 codes the variable speed 
reproduction map RAM (Step S12). The variable length 
coding unit 112 further codes the current picture (Step 
S13). 

[0064] On the other hand, if the current picture is not 
a picture at a random access point as a result of the 
judgment (NO in Step S1 0), the variable length coding 
unit 112 codes the current picture (Step S13). 
[0065] Next, it is judged whetherthere are any uncod- 
ed pictures or not (Step S1 4), the above operation (Step 
S10 - Step S14) is repeated if there are any uncoded 
pictures, and the processing is ended if there is no un- 
coded picture. 

[0066] By the way, when decoding the bit stream Str, 
a picture parameter set P PS is referred to for decoding, 
as mentioned above. When the picture parameter set 
PPS was changed, this new picture parameter set PPS 
has already been sent as a bit stream Str before data of 
a reference picture. However, variable speed reproduc- 



tion causes a situation where this changed new picture 
parameter set PPS does not exist when decoding a pic- 
ture which should referto this new picture parameter set 
PPS. For example, in the example as shown in FIG. 9B, 
5 the pictures 10, P4, B2, B1, B3, P8, B6, B5 and B7 are 
coded in this order. It is assumed here that a picture pa- 
rameter set PPS is changed in the picture B2 and the 
changed new picture parameter set PPS is added to the 
data of the picture B2 referring to that new picture pa- 
10 rameter set PPS. In this case, there is no problem in 
reproduction at normal speed and double speed. How- 
ever, for quad-speed reproduction, for example, the pic- 
tures 10, P4 and P8 are reproduced but the picture B2 
is not decoded, and thus the changed new picture pa- 
15 rameter set PPS is not decoded, too. Therefore, the pic- 
ture parameter set PPS that should be referred to by the 
picture P8 has not been decoded, a problem that the 
picture P8 cannot be decoded occurs. 
[0067] Against this backdrop, in the present embodi- 
ment, when a picture parameter set PPS is necessary 
for a picture which is to be reproduced at N times speed, 
it is always added to that picture to be reproduced at N 
times speed even if it has been added to a picture which 
is to be reproduced at slower speed than N. In other 
words, in the above example, the new picture parameter 
set PPS changed in the picture B2 is also added to the 
data of the picture P8. 

[0068] FIG. 11 is a flowchart showing an operation for 
adding a picture parameter set PPS. 
[0069] The detection unit 1 1 4 judges whether or not a 
current picture to be coded is to be reproduced (decod- 
ed) at N times or faster speed (Step S20). When the 
current picture is to be reproduced at N times or faster 
speed as a result of the judgment (YES in Step S20), it 
is judged whether or not a picture parameter set PPS 
referred to by the current picture has already been cod- 
ed when coding a picture which is to be reproduced at 
N times or faster speed (Step S21). Here, the picture 
parameterset PPS has notyetbeen coded when coding 
the picture to be reproduced at N times or faster speed 
(NO in Step S21 ), the common information addition unit 
1 1 5 outputs the picture parameter set PPS to the varia- 
ble length coding unit 1 1 2 in order to add it to the current 
picture (Step S22). Next, the variable length coding unit 
112 codes the picture parameter set PPS (Step S23). 
The variable length coding unit 112 further codes the 
current picture (Step S24). 

[0070] On the other hand, when the picture is not to 
be reproduced at N times or faster speed as a result of 
the above judgment (NO in Step S20), and when the 
picture parameter set PPS which is referred to by the 
current picture has already been coded when coding the 
picture to be reproduced at N times orf aster speed (YES 
in Step S21 ), the variable length coding unit 1 1 2 codes 
the current picture (Step S24). 

[0071] Next, it is judged whetherthere are any uncod- 
ed pictures or not (Step S25), and the above operation 
(Steps S20 - S25) is repeated if there are any, and the 
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processing is ended if there is no uncoded picture. 
[0072] FIG. 1 2 is a flowchart showing an operation for 
coding a current picture. 

[0073] The detection unit 11 4 judges whether or not a 
current picture to be coded is to be reproduced (decod- 
ed) at N times or faster speed (Step S30). When the 
current picture is to be reproduced at N times or faster 
speed as a result of the judgment (YES in Step S30), it 
is coded with reference to a picture to be reproduced at 
N times or faster speed (Step S31). On the other hand, 
when the current picture is not to be reproduced at N 
times or faster speed (NO in Step S30), it is coded with 
reference to an arbitrary picture (Step S32). 
[0074] Next, it is judged whether or not the current pic- 
ture is referred to when coding another picture (Step 
S33). When the current picture is referred to by another 
picture as a result of the judgment (YES in Step S33), it 
is stored in the picture memory 109 (Step S34). On the 
other hand, when the current picture is not referred to 
by another picture (NO in Step S33), it is not stored in 
the picture memory 1 09. 

[0075] Next, it is judged whetherthere are any uncod- 
ed pictures or not (Step S35), the above operation 
(Steps S30 - S35) is repeated if there are any uncoded 
pictures, and the processing is ended if there is no un- 
coded picture. 

[0076] As described above, a variable speed repro- 
duction map RAM is placed before pictures in a random 
access unit RAU, and information indicating which pic- 
ture stream should be decoded for desired variable 
speed reproduction is described in the variable speed 
reproduction map RAM. Even if a picture parameter set 
PPS has already been added to a picture to be repro- 
duced at less than N times speed, the picture parameter 
set PPS is also always added to a picture to be repro- 
duced at N times speed if it is necessary for that picture 
to be reproduced at N times speed. Therefore, the mov- 
ing picture decoding apparatus decodes only pictures 
necessary for desired variable speed reproduction ac- 
cording to the information described in the variable 
speed reproduction map RAM, and thus allows variable 
speed reproduction easily without decoding unneces- 
sary pictures. 

[0077] When creating a variable speed reproduction 
map RAM in the present embodiment, since pictures 
which are not referred to by other pictures have no in- 
fluence on decoding the other pictures, the variable 
speed reproduction map RAM may be created so as to 
be used for only pictures referred to by other pictures 
and having influence on the other pictures. Or, some- 
thing having a function corresponding to the variable 
speed reproduction map RAM, for example, operation 
information by category, such as pictures which are not 
referred to by other pictures, l-pictures, P-pictures and 
B-pictures, may be placed instead of information of each 
picture. 

[0078] Furthermore, identification information indicat- 
ing that the entire stream is made up of these random 



access units RAUs that can be easily reproduced at var- 
iable speed may be added. 

[0079] Explanation has been made assuming that a 
picture M does not need to be decoded in a case of N<K, 
5 whereas the picture M needs to be decoded in a case 
of N>=K, where N is Speed of the picture M (information 
indicating the speed at which the picture M needs to be 
decoded) and K is reproduction speed, for example. But 
the picture M may be decoded even in a case of N<K in 
10 orderto improve image quality for variable speed repro- 
duction when a difference between N and K is small. 
[0080] In addition, the above-mentioned information 
indicating the reproduction speed required for decoding 
(Speed) may be a value indicating a level of reproduc- 
es tion speed, not a value representing an actual reproduc- 
tion speed. For example, "1", "2" and "3" can be as- 
signed to pictures necessary for only normal speed re- 
production, pictures necessary for faster speed repro- 
duction and pictures necessary for still faster speed re- 
20 production, respectively. 

(Second Embodiment) 

[0081] The first embodiment shows an example in 

25 which variable speed reproduction maps RAMs are 
placed in respective random access units RAUs, but 
there is no need to place the variable speed reproduc- 
tion maps RAMs in the respective random access units 
RAUs if they have the same contents. 

30 [0082] FIG. 13Aand FIG. 13B are diagrams of a struc- 
ture of a stream in the second embodiment. 
[0083] In the present embodiment, a variable speed 
reproduction map table RAMTBL, as shown in FIG. 13B, 
including a plurality of variable speed reproduction 

35 maps RAMs based on reference relationships between 
pictures as shown in FIGs. 9A - 9C, for example, is cre- 
ated. And in each random access unit RAU, a variable 
speed reproduction map identifier RAM ID indicating to 
which variable speed reproduction map RAM in the var- 

40 iable speed reproduction map table RAMTBL the ran- 
dom access unit RAU corresponds is placed, as shown 
in FIG. 13A. 

[0084] The variable speed reproduction map table 
RAMTBL may be placed at the head of the stream, cod- 
45 ed as added information in another stream, or imple- 
mented in a device by predetermining values for the ta- 
ble. 

[0085] FIG. 14 is a flowchart showing an operation for 
creating a variable speed reproduction map identifier 

50 RAM ID. Here, creation and coding of the variable speed 
reproduction map identifier RAM ID are performed 
(Steps S41 - S42) instead of creation and coding of the 
variable speed reproduction map RAM in the first em- 
bodiment (Steps S11 - S12 in FIG. 10). 

55 [0086] As a result of the above creation and coding, 
what is realized in the first embodiment can also be re- 
alized in the present embodiment using the variable 
speed reproduction map identifier RAM ID. 
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[0087] When creating a variable speed reproduction 
map RAM which is to be included in the variable speed 
reproduction map table RAMTBL, pictures which are not 
referred to by other pictures have no influence on de- 
coding of the other pictures, and therefore, variable 
speed reproduction maps RAMs may be created only 
for the pictures referred to by the other pictures and hav- 
ing influence on the other pictures. Or, something with 
a function corresponding to that of the variable speed 
reproduction map RAM, for example, operation informa- 
tion by category such as pictures which are not referred 
to by other pictures, l-pictures, P-pictures and B-pic- 
tures, may be placed, instead of placing information of 
each picture. 

[0088] Furthermore, identification information indicat- 
ing that the entire stream is made up of these random 
access units RAU that can be easily reproduced at var- 
iable speed may be added. 

[0089] In the first and second embodiments, variable 
speed reproduction map RAM and a variable speed re- 
production map identifier RAMI D are added to each ran- 
dom access unit RAU, but the present invention is not 
limited to this. For example, all the random access units 
in the entire stream have the same structure, the varia- 
ble speed reproduction map RAM and the variable 
speed reproduction map identifier RAM ID may be 
placed in each stream. 

[0090] In addition, in the first and second embodi- 
ments, only a case where at least one variable speed 
reproduction map RAM is coded has been explained. 
But a fixed variable speed reproduction map RAM could 
be used depending on the operation, and in such a case, 
the variable speed reproduction map RAM does not 
need to be coded. In order to allow this operation, it is 
only necessary to detect in advance the need of coding 
common information referred to by a current picture to 
be reproduced at variable speed and to add the common 
information to the current picture if the need of coding 
that common information is detected. 

(Third Embodiment) 

[0091] FIG. 15 is a block diagram showing a structure 
of a moving picture decoding apparatus using a moving 
picture decoding method according to the present in- 
vention. The same reference numbers are assigned to 
the units that operate in the same manner as those in 
the conventional moving picture decoding apparatus 4 
as shown in FIG. 4 and the explanation thereof is omit- 
ted. 

[0092] A moving picture decoding apparatus 2 is an 
apparatus for decoding the bit stream Str obtained by 
coding by the moving picture coding apparatus 1 as 
mentioned above, and includes a stream extraction unit 
201 , a variable length decoding unit 202, an extractive 
picture selection unit 203, a motion compensation unit 
204, an inverse quantization unit 205, an inverse orthog- 
onal transformation unit 206, an addition unit 207, a pic- 



ture memory 208 and a memory control unit 209. 
[0093] The extractive picture selection unit 203 deter- 
mines, based on the variable speed reproduction infor- 
mation Map decoded by the variable length decoding 
5 unit 202, a picture which needs to be decoded for repro- 
duction at a reproduction speed instructed by reproduc- 
tion speed information PlaySpeed inputted from out- 
side, and notifies it to the stream extraction unit 201. 
The stream extraction unit 201 extracts only the stream 
corresponding to the picture that is judged the need of 
decoding by the extractive picture selection unit 203 and 
transmits itto the variable length decoding unit 202. The 
memory control unit 209 controls pictures referred to by 
other pictures for variable speed reproduction, assum- 
ing that the pictures are stored in the picture memory 
208 even if they have not yet been decoded. 
[0094] Next, operations of the moving picture decod- 
ing apparatus 2 structured as mentioned above will be 
explained. FIGs. 16A and 16B are flowcharts showing 
the operations of the moving picture decoding appara- 
tus 2, and more specifically, FIG. 16A shows the oper- 
ation for the structure of the stream as shown in the first 
embodiment, and FIG. 1 6B shows the operation forthe 
structure of the stream as shown in the second embod- 
iment. 

[0095] When decoding the bit stream Str structured 
as shown in the first embodiment obtained by coding, 
the stream extraction unit 201 judges whether or not a 
current picture to be decoded is a random access point, 
namely, the first picture in a random access unit RAU 
(Step S50). When the current picture is a random ac- 
cess point as a result of the judgment (YES in Step S50), 
the stream extraction unit 201 extracts a variable speed 
reproduction map RAM and outputs it to the variable 
length decoding unit 202 (Step S51 ). Then, the variable 
length decoding unit 202 decodes the variable speed 
reproduction map RAM and outputs it to the extractive 
picture selection unit 203 (Step S52). 
[0096] Next, the extractive picture selection unit 203 
determines, based on the variable speed reproduction 
map RAM decoded by the variable length decoding unit 
202, a picture which needs to be decoded for reproduc- 
tion at a reproduction speed instructed by the reproduc- 
tion speed information PlaySpeed inputted from out- 
side, and notifies it to the stream extraction unit 201 
(Step S53). The stream extraction unit 201 judges 
whether or not the extractive picture selection unit 203 
determines that decoding of the current picture is un- 
necessary (Step S54). Here, when the decoding of the 
current picture is not determined unnecessary (NO in 
Step S54), the stream extraction unit 201 extracts only 
the stream corresponding to the current picture and out- 
puts it to the variable length decoding unit 202. The var- 
iable length decoding unit 202 decodes the stream cor- 
responding to the inputted picture (Step S55). 
[0097] Next, it is judged whether there are any unde- 
coded pictures or not (Step S56), and the above oper- 
ation (Steps S50 - S56) is repeated if there are any un- 
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decoded pictures, and the processing is ended if there 
is no undecoded picture. 

[0098] When decoding the bit stream Str structured 
as shown in the second embodiment obtained by cod- 
ing, if a current picture to be decoded is a picture at a 
random access point as shown in FIG. 1 6B (YES in Step 
S50), the stream extraction unit 201 extracts the varia- 
ble speed reproduction map identifier RAM ID, and out- 
puts it to the variable length decoding unit 202 (Step 
S61). Then, the variable length decoding unit 202 de- 
codes the variable speed reproduction map identifier 
RAM ID and outputs it to the extractive picture selection 
unit 203 (Step S62). 

[0099] Next, the extractive picture selection unit 203 
determines, based on the variable speed reproduction 
map identifier RAMID and the variable speed reproduc- 
tion map table RAMTBL decoded by the variable length 
decoding unit 202, a picture which needs to be decoded 
for reproduction at a reproduction speed instructed by 
the reproduction speed information PlaySpeed inputted 
from outside, and notifies it to the stream extraction unit 
201 (Step S63). The subsequent operation is same as 
that of decoding the bit stream Str structured as shown 
in the first embodiment obtained by coding. Note that it 
is assumed here that the variable speed reproduction 
map table RAMTBL has been decoded in advance and 
included in the extractive picture selection unit 203. 
[0100] By the way, since a reference picture is spec- 
ified using a relative reference index Index for decoding 
a current picture, the picture specified as a reference 
picture for variable speed reproduction is sometimes dif- 
ferent from a reference picture for coding. For example, 
in the example of the stream as shown in FIG. 9B, when 
reproducing all the pictures at normal speed, all the ref- 
erence pictures 10, P4 and B2 are stored in the picture 
memory 208 as shown in FIG. 1 7A for decoding the pic- 
ture P8. On the other hand, in a case of quad-speed 
reproduction, the pictures 10 and P4 which are to be re- 
produced (decoded) at quad speed and referred to are 
stored in the picture memory 208 as shown in FIG. 1 7B. 
Therefore, use of a reference index Index specifying the 
picture P4 referred to by the picture P8 (specifying the 
2 preceding picture in the picture memory 208) for quad- 
speed reproduction results in specification of the picture 
1 0 as shown in FIG. 1 7B, which brings about an adverse 
consequence. 

[0101] Against this backdrop, in the present embodi- 
ment, pictures that are not reproduced but referred to 
by other pictures in a case of variable speed reproduc- 
tion are always handled assuming that they are stored 
in the picture memory 208. In other words, in the above 
example, control is exerted assuming that data is stored 
following the picture P4, as shown in FIG. 17C. 
[0102] FIG. 18 is a flowchart showing an operation for 
decoding a current picture. The operation shown in this 
flowchart corresponds to the processing of judging 
whether decoding is unnecessary or not, the processing 
of decoding a current picture and the processing of judg- 



ing whether there are any undecoded pictures or not 
(Steps S53 - S56) in the flowchart as shown in FIGs. 
16A and 16B. 

[01 03] The stream extraction unit 201 judges whether 
5 or not it is determined that the current picture needs to 
be decoded at N times speed (Step S90). When it is de- 
termined that the current picture needs to be decoded 
(YES in Step S90), the variable length decoding unit 202 
decodes the current picture with reference to a picture 
10 that has been decoded at N times or faster speed (Step 
S91). Next, the memory control unit 209 judges whether 
or notthere exists a picture which has not been decoded 
at N times speed but is to be referred to by another pic- 
ture (Step S92). 

[0104] When such a picture exists as a result of this 
judgment (YES in Step S92), the memory control unit 
209 assumes that this picture which has not been de- 
coded at N times speed but is to be referred to by an- 
other picture is stored in the picture memory 208 (Step 

593) . Next, the memory control unit 209 stores the de- 
coded current picture in the picture memory 208 (Step 

594) . 

[0105] On the other hand, when there exist no such 
picture (NO in Step S92), the memory control unit 209 
just stores the decoded current picture in the picture 
memory 208 (Step S94). 

[0106] Next, it is judged whether there are any unde- 
coded pictures or not (Step S95), the above operation 
(Steps S90 - S95) is repeated if there are any undecod- 
ed pictures, and the processing is ended if there is no 
undecoded picture. Also, when the current picture does 
not need to be decoded at N times speed (NO in Step 
S90), it is judged whether there are any undecoded pic- 
tures or not (Step S95), and the above operation (Steps 
S90 - S95) is repeated if there are any undecoded pic- 
tures, and the processing is ended if there is no unde- 
coded picture. 

[0107] As described above, by decoding, based on 
the variable speed reproduction information Map, only 
pictures necessary for desired variable speed reproduc- 
tion in the bit stream Str obtained by coding as shown 
in the first and second embodiments, variable speed re- 
production can be realized easily without decoding un- 
necessary pictures. 

(Fourth Embodiment) 

[0108] In the present embodiment, operations of the 
moving picture decoding apparatus 2 that are partially 
different from the operation thereof as shown in the third 
embodiment will be explained. 

[0109] FIG. 19A and FIG. 19B are flowcharts of the 
operations of the moving picture decoding apparatus 2, 
and more specifically, FIG. 19A shows an operation for 
the structure of the stream as shown in the first embod- 
iment and FIG. 19B shows an operation for the structure 
of the stream as shown in the second embodiment. In 
FIGs. 19A and 1 9B, the same step numbers are as- 
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signed to the processes same as the processes in the 
flowchart of FIGs. 16A and 16B and the explanation 
thereof is omitted. 

[0110] In the third embodiment, the stream extraction 
unit 201 judges whether or not a current picture to be 
decoded is the first picture in a random access unit RAU 
(Step S50) as shown in FIG. 16A, whereas in the 
present embodiment, it just judges whether or not a var- 
iable speed reproduction map RAM is placed (Step S70) 
as shown in FIG. 19A. When the variable speed repro- 
duction map RAM is placed as a result of the judgment 
(YES in S70), the stream extraction unit 201 extracts the 
variable speed reproduction map RAM and outputs it to 
the variable length decoding unit 202 (Step S51). 
[0111] Similarly, in FIG. 16B, the stream extraction 
unit 201 judges whether or not a current picture to be 
decoded is the first picture in a random access unit RAU 
(Step S50), whereas in the present embodiment, it just 
judges whether a variable speed reproduction map 
identifier RAM ID is placed or not (Step S80) as shown 
in FIG. 19B. When the variable speed reproduction map 
identifier RAM ID is placed (YES in S80), the stream ex- 
traction unit 201 extracts the variable speed reproduc- 
tion identifier RAM ID and outputs itto the variable length 
decoding unit 202 (Step S61). 

[0112] As described above, judging whether the var- 
iable speed reproduction map RAM or the variable 
speed reproduction map identifier RAMID is placed or 
not also allows variable speed reproduction easily with- 
out decoding unnecessary pictures, by decoding, based 
on the variable speed reproduction information Map , on- 
ly pictures necessary for desired variable speed repro- 
duction in the bit stream Str obtained by coding as 
shown in the first and second embodiments. 

(Fifth Embodiment) 

[0113] If a program for realizing the moving picture 
coding method and the moving picture decoding method 
as shown in each of the above embodiments is recorded 
on a memory medium such as aflexible disk, it becomes 
possible to perform the processing as shown in each of 
the embodiments easily in an independent computer 
system. 

[01 1 4] FIGs. 20A, 20B and 20C are illustrations show- 
ing the case where the moving picture coding method 
and the moving picture decoding method in each of the 
above embodiments are performed in a computer sys- 
tem using a program recorded on a recording medium 
such as a flexible disk. 

[0115] FIG. 20B shows a front view of an appearance 
of a flexible disk, a cross-sectional view thereof and the 
flexible disk itself, and FIG. 20A shows an example of a 
physical format of the flexible disk as a recording medi- 
um body. The flexible disk FD is contained in a case F, 
and a plurality of tracks Tr are formed concentrically on 
the surface of the disk in the radius direction from the 
periphery to the inside, and each track is divided into 1 6 



sectors Se in the angular direction. Therefore, as forthe 
flexible disk storing the above-mentioned program, the 
program is recorded in an area allocated for it on the 
flexible disk FD. 
5 [0116] Fig. 20C shows a structure for recording and 
reproducing the program on and from the flexible disk 
FD. When the program for realizing the moving picture 
coding method andthe moving picture decoding method 
is recorded on theflexible disk FD, the program is written 
10 in the flexible disk from the computer system Cs via a 
flexible disk drive. When the moving picture coding 
method and the moving picture decoding method are 
constructed in the computer system by the program on 
the flexible disk for realizing the moving picture coding 
15 method and the moving picture decoding method, the 
program is read out from the flexible disk using the flex- 
ible disk drive and transferred to the computer system. 
[0117] The above explanation is made on the as- 
sumption that a recording medium is a flexible disk, but 
20 the same processing can also be performed using an 
optical disk. In addition, the recording medium is not lim- 
ited to a flexible disk and an optical disk, but the same 
processing can be performed using any other medium 
such as an IC card and a ROM cassette capable of re- 
25 cording a program. 

(Sixth Embodiment) 

[0118] Furthermore, applications of the moving pic- 

30 ture coding method and the moving picture decoding 
method as shown in the above embodiments and sys- 
tems using these methods will be explained. 
[0119] Fig. 21 is a block diagram showing the overall 
configuration of a content supply system ex100 for re- 

35 alizing a content distribution service. The area for pro- 
viding communication service is divided into cells of de- 
sired size, and base stations ex107 ~ex110 that are 
fixed wireless stations are placed in respective cells. 
[0120] In this content supply system ex100, devices 

40 such as a computer ex1 1 1 , a PDA (personal digital as- 
sistant) ex112, a camera ex113, a mobile phone ex114 
and a camera-equipped mobile phone ex115 are con- 
nected to the Internet ex 1 01 via an Internet service pro- 
vider ex102, a telephone network ex104 and base sta- 

45 tions ex1 07~ex110. 

[0121] However, the content supply system ex100 is 
not limited to the configuration as shown in Fig. 21 , and 
any combination of them may be connected. Also, each 
device may be connected directly to the telephone net- 

50 work ex104, not through the base stations 
ex107~ex110. 

[01 22] The camera ex1 1 3 is a device such as a digital 
video camera capable of shooting moving pictures. The 
mobile phone may be a mobile phone of a PDC (Per- 
55 sonal Digital Communications) system, a CDMA (Code 
Division Multiple Access) system, a W-CDMA (Wide- 
band-Code Division Multiple Access) system or a GSM 
(Global System for Mobile Communications) system, a 
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PHS (Personal Handyphone system) or the like, and 
any of them can be used. 

[0123] A streaming server ex103 is connected to the 
camera ex1 1 3 via the base station ex1 09 and the tele- 
phone network ex104, which allows live distribution or 
the like using the camera ex1 1 3 based on the coded da- 
ta transmitted from a user. Either the camera ex113 or 
the server or the like for transmitting the data may code 
the shot data. Also, the moving picture data shot by a 
camera ex116 may be transmitted to the streaming serv- 
er ex1 03 via the computer ex1 1 1 . The camera ex1 1 6 is 
a device such as a digital camera capable of shooting 
still and moving pictures. In this case, eitherthe camera 
ex1 1 6 or the computer ex1 1 1 may code the moving pic- 
ture data. An LSI ex1 1 7 included in the computer ex1 1 1 
or the camera ex1 1 6 actually performs coding process- 
ing. Software for coding and decoding pictures may be 
integrated into any type of storage medium (such as a 
CD-ROM, a flexible disk and a hard disk) that is a re- 
cording medium which is readable by the computer 
ex111 or the like. Furthermore, the camera-equipped 
mobile phone ex115 may transmit the moving picture 
data. This moving picture data is the data coded by the 
LSI included in the mobile phone ex115. 
[0124] The content supply system ex1 00 codes con- 
tents (such as a music live video) shot by users using 
the camera ex1 13, the camera ex1 1 6 or the like in the 
same manner as the above embodiments and transmits 
them to the streaming server ex1 03, wh ile the streaming 
server ex1 03 makes stream distribution of the contents 
data to the clients at their request. The clients include 
the computer ex1 1 1 , the PDA ex1 1 2, the camera ex1 1 3, 
the mobile phone ex114 and so on capable of decoding 
the above-mentioned coded data. In the content supply 
system ex100, the clients can thus receive and repro- 
duce the coded data, and furtherthe clients can receive, 
decode and reproduce the data in real time so as to re- 
alize personal broadcasting. 

[0125] When each device in this system performs 
coding or decoding, the moving picture coding appara- 
tus orthe moving picture decoding apparatus, as shown 
in each of the above-mentioned embodiments, can be 
used. 

[0126] A mobile phone will be explained as an exam- 
ple of the device. 

[0127] Fig. 22 is a diagram showing the mobile phone 
ex115 that uses the moving picture coding method and 
the moving picture decoding method explained in the 
above embodiments. The mobile phone ex115 has: an 
antenna ex201 for sending and receiving radio waves 
to and from the base station ex1 1 0; a camera unit ex203 
such as a CCD camera capable of shooting video and 
still pictures; a display unit ex202 such as a liquid crystal 
display for displaying the data obtained by decoding vid- 
eo and the like shot by the camera unit ex203 and re- 
ceived via the antenna ex201; a body unit including a 
set of operation keys ex204; a voice output unit ex208 
such as a speaker for outputting voices; a voice input 



unit 205 such as a microphone for inputting voices; a 
storage medium ex207 forstoring coded or decoded da- 
ta such as data of shot moving or still pictures, data of 
received e-mails, data of moving or still pictures; and a 
5 slot unit ex206 for attaching the storage medium ex207 
to the mobile phone ex115. The storage medium ex207 
includes a flash memory element, a kind of EEPROM 
(Electrically Erasable and Programmable Read Only 
Memory) that is an electrically erasable and rewritable 
10 nonvolatile memory, in a plastic case such as an SD 
card. 

[0128] The mobile phone ex115 will be further ex- 
plained with reference to Fig. 23. In the mobile phone 
ex115, a main control unit ex311 for overall controlling 
the display unit ex202 and the body unit including oper- 
ation keys ex204 is connected to a power supply circuit 
unit ex31 0, an operation input control unit ex304, a pic- 
ture coding unit ex312, a camera interface unit ex303, 
an LCD (Liquid Crystal Display) control unit ex302, a pic- 
ture decoding unit ex309, a multiplex/demultiplex unit 
ex308, a record/reproduce unit ex307, a modem circuit 
unit ex306 and a voice processing unitex305, and these 
units are connected to each other via asynchronous bus 
ex313. 

[0129] When a call-end key or a power key is turned 
ON by a user's operation, the power supply circuit unit 
ex310 supplies respective units with power from a bat- 
tery pack so as to activate the camera-equipped digital 
mobile phone ex115 for making it into a ready state. 
[0130] In the mobile phone ex115, the voice process- 
ing unit ex305 converts the voice signals received by 
the voice input unit ex205 in voice conversation mode 
into digital voice data under the control of the main con- 
trol unitex311 including a CPU, ROM and RAM orthe 
like, the modem circuit unit ex306 performs spread 
spectrum processing of the digital voice data, and the 
send/receive circuit unit ex301 performs digital-to-ana- 
log conversion and frequency transform of the data, so 
as to transmit it via the antenna ex201 . Also, in the mo- 
bile phone ex1 1 5, after the data received by the antenna 
ex201 in voice conversation mode is amplified and per- 
formed of frequency transform and analog-to-digital 
conversion, the modem circuit unit ex306 performs in- 
verse spread spectrum processing of the data, and the 
voice processing unit ex305 converts it into analog voice 
data, so as to output it via the voice output unit 208. 
[0131] Furthermore, when transmitting e-mail in data 
communication mode, the text data of the e-mail input- 
ted by operating the operation keys ex204 on the body 
unit is sent out to the main control unit ex311 via the 
operation input control unit ex304. After the modem cir- 
cuit unit ex306 performs spread spectrum processing of 
the text data and the send/receive circuit unit ex301 per- 
forms digital-to-analog conversion and frequency trans- 
form for it, the main control unit ex311 transmits the re- 
sulting data to the base station ex110 via the antenna 
ex201. 

[0132] When picture data is transmitted in data com- 
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munication mode, the picture data shot by the camera 
unit ex203 is supplied to the picture coding unit ex312 
via the camera interface unit ex303. When the picture 
data is not transmitted, it is also possible to display the 
picture data shot by the camera unit ex203 directly on 
the display unit 202 via the camera interface unit ex303 
and the LCD control unit ex302. 
[0133] The picture coding unit ex31 2, which includes 
the moving picture coding apparatus as explained in the 
present invention, compresses and codes the picture 
data supplied from the camera unit ex203 by the coding 
method used for the moving picture coding apparatus 
as shown in the above embodiments so as to transform 
it into coded picture data, and sends it out to the multi- 
plex/demultiplex unit ex308. At this time, the mobile 
phone ex1 15 sends outthe voices received by the voice 
input unit ex205 during shooting by the camera unit 
ex203 to the multiplex/demultiplex unit ex308 as digital 
voice data via the voice processing unit ex305. 
[0134] The multiplex/demultiplex unit ex308 multi- 
plexes the coded picture data supplied from the picture 
coding unit ex31 2 and the voice data supplied from the 
voice processing unit ex305 by a predetermined meth- 
od, the modem circuit unit ex306 performs spread spec- 
trum processing of the multiplexed data obtained as a 
result of the multiplexing, and the send/receive circuit 
unit ex301 performs digital-to-analog conversion and 
frequency transform on the data for transmitting via the 
antenna ex201 . 

[0135] As for receiving data of a moving picture file 
which is linked to a Web page or the like in data com- 
munication mode, the modem circuit unit ex306 per- 
forms inverse spread spectrum processing on the data 
received from the base station ex110 via the antenna 
ex201 , and sends out the multiplexed data obtained as 
a result of the processing to the multiplex/demultiplex 
unit ex308. 

[0136] In order to decode the multiplexed data re- 
ceived via the antenna ex201 , the multiplex/demultiplex 
unit ex308 separates the multiplexed data into a bit 
stream of picture data and a bit stream of voice data, 
and supplies the coded picture data to the picture de- 
coding unit ex309 and the voice data to the voice 
processing unit ex305 respectively via the synchronous 
bus ex313. 

[0137] Next, the picture decoding unit ex309, which 
includes the picture decoding apparatus as explained in 
the present invention, decodes the bit stream of picture 
data by the decoding method corresponding to the cod- 
ing method as shown in the above-mentioned embodi- 
ments to generate reproduced moving picture data, and 
supplies this data to the display unit ex202 via the LCD 
control unit ex302, and thus moving picture data includ- 
ed in a moving picture file linked to a Web page, for in- 
stance; is displayed. At the same time, the voice 
processing unit ex305 converts the voice data into an- 
alog voice data, and supplies this data to the voice out- 
put unit ex208, and thus voice data included in a moving 



picture file linked to a Web page, for instance, is repro- 
duced. 

[0138] The present invention is not limited to the 
above-mentioned system, and at least either the moving 
5 picturecoding apparatus orthe moving picture decoding 
apparatus in the above-mentioned embodiments can be 
incorporated into a system for digital broadcasting as 
shown in Fig. 24. Such ground-based or satellite digital 
broadcasting has been in the news lately. More specif- 
ic ically, a bit stream of video information is transmitted 
from a broadcast station ex409 to a communication or 
broadcast satellite ex41 0 via radio waves. Upon receipt 
of it, the broadcast satellite ex41 0 transmits radio waves 
for broadcasting, a home-use antenna ex406 with a sat- 
*5 ellite broadcast reception setup receives the radio 
waves, and a device such as a television (receiver) 
ex401 or a set top box (STB) ex407 decodes the bit 
stream for reproduction. The moving picture decoding 
apparatus as shown in the above-mentioned embodi- 
20 ments can be implemented in the reproduction appara- 
tus ex403 for reading off and decoding the bit stream 
recorded on a storage medium ex402 that is a recording 
medium such as a CD and DVD. In this case, the repro- 
duced video signals are displayed on a monitor ex404. 
25 it is also conceived to implement the moving picture de- 
coding apparatus in the set top box ex407 connected to 
a cable ex405 for a cable television or the antenna 
ex406 for satellite and/or ground-based broadcasting so 
as to reproduce them on a monitor ex408 of the televi- 
se sion. The moving picture decoding apparatus may be 
incorporated into the television, not in the set top box. 
Or, a car ex412 having an antenna ex411 can receive 
signals from the satellite ex41 0, the base station ex1 07 
or the like for reproducing moving pictures on a display 
35 device such as a car navigation system ex41 3 in the car 
ex412. 

[0139] Furthermore, the moving picture coding appa- 
ratus as shown in the above-mentioned embodiments 
can code picture signals for recording them on a record- 

40 ing medium. As a concrete example, there is a recorder 
ex420 such as a DVD recorder for recording picture sig- 
nals on a DVD disc ex421 and a disk recorder for re- 
cording them on a hard disk. They can be recorded on 
an SD card ex422. If the recorder ex420 includes the 

45 moving picture decoding apparatus as shown in the 
above-mentioned embodiments, the picture signals re- 
corded on the DVD disc ex421 or the SD card ex422 
can be reproduced for display on the monitor ex408. 
[0140] As the structure of the car navigation system 

50 ex413, the structure without the camera unit ex203, the 
camera interface unit ex303 and the picture coding unit 
ex312, out of the units shown in Fig. 23, can be con- 
ceived. The same applies to the computer ex111, the 
television (receiver) ex401 and others. 

55 [0141] In addition, three types of implementations can 
be conceived for a terminal such as the above-men- 
tioned mobile phone ex114; a sending/receiving termi- 
nal including both an encoder and a decoder, a sending 
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terminal including an encoder only, and a receiving ter- 
minal including a decoder only. 

[0142] As described above, it is possible to use the 
moving picture coding method orthe moving picture de- 
coding method as shown in the above-mentioned em- 5 
bodiments in any of the above-mentioned apparatuses 5. 
and systems, and using this method, the effects de- 
scribed in the above embodiments can be obtained. 
[0143] The present invention is not limited to the 
above-mentioned embodiments, and various changes 10 
and modifications may be made without departing from 
the spirit and scope of the invention. 

6. 

Industrial Applicability 

15 

[0144] As described above, the moving picture coding 
method and the moving picture decoding method ac- 
cording to the present invention are valuable as meth- 
ods for coding pictures that make up a moving picture 
so as to generate a bit stream and decoding the gener- 20 7. 
ated bit stream in a mobile phone : a DVD apparatus, a 
personal computer and the like, for example. 



Claims 25 

1 . A moving picture coding method for coding a mov- 
ing picture signal on a picture-by-picture basis and 8. 
generating a bit stream, comprising: 

30 

an information creation step of creating varia- 
ble speed reproduction information for specify- 
ing pictures to be reproduced at variable speed; 
and 

a coding step of coding the variable speed re- 35 
production information and adding said infor- 
mation to the bit stream. 

2. The moving picture coding method according to 
Claim 1, 40 

wherein in the information creation step, the 9. 
variable speed reproduction information is created 
for each random access unit that is made up of a 
plurality of pictures, said random access unit being 
a unit in which a current picture to be decoded can 45 
be decoded with reference to another picture only 
in the random access unit. 

1C 

3. The moving picture coding method according to 
Claim 1 , 50 

wherein in the information creation step, the 
variable speed reproduction information is created 
by associating speeds for variable speed reproduc- 
tion with information specifying the pictures to be 
reproduced at said speeds respectively. 55 

4. The moving picture coding method according to 
Claim 3, 



wherein in the variable speed reproduction in- 
formation, the speeds at which the pictures need to 
be decoded are described respectively according 
to picture numbers of said pictures. 

The moving picture coding method according to 
Claim 3 ; 

wherein in the variable speed reproduction in- 
formation, the speeds at which the pictures need to 
be decoded are described respectively in se- 
quence. 

The moving picture coding method according to 
Claim 3 ; 

wherein in the variable speed reproduction in- 
formation, picture numbers of pictures necessary 
for the reproduction at the speeds are described for 
each of the speeds. 

The moving picture coding method according to 
Claim 1 , 

wherein in the information creation step, an 
index is created as the variable speed reproduction 
information, the index specifying a corresponding 
reference relationship in a list of predetermined ref- 
erence relationships. 

The moving picture coding method according to 
Claim 7, 

wherein the list of predetermined reference 
relationships is a map table having a plurality of sets 
of map information in which speeds for variable 
speed reproduction are associated with information 
specifying the pictures to be reproduced at said 
speeds respectively, and 

in the information creation step, an identifier 
for selecting corresponding map information in the 
map table is created as the variable speed repro- 
duction information. 

The moving picture coding method according to 
Claim 8, 

wherein in the information creation step, the 
map table is created, and 

in the coding step, the map table is coded and 
added to the bit stream. 

The moving picture coding method according to 
Claim 1 . further comprising: 

a detection step of detecting whether common 
information needs to be coded or not, said com- 
mon information being referred to by the pic- 
tures to be reproduced at variable speed; and 
a common information addition step of adding 
the common information to the pictures when it 
is detected in the detection step that said infor- 
mation needs to be coded. 
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11. A moving picture decoding method for decoding a 
bit stream on a picture-by-picture basis, comprising: 

an information extraction step of extracting var- 
iable speed reproduction information for spec- 
ifying pictures to be reproduced at variable 
speed; and 

a decoding step of decoding the variable speed 
reproduction information and specifying and 
decoding the pictures to be reproduced at var- 
iable speed based on the variable speed repro- 
duction information. 

12. The moving picture decoding method according to 
Claim 11 , 

wherein in the information extraction step, the 
variable speed reproduction information is extract- 
ed from each random access unit that is made up 
of a plurality of pictures, said random access unit 
being a unit in which a current picture to be decoded 
can be decoded with reference to another picture 
only in the random access unit. 

13. The moving picture decoding method according to 
Claim 11 , 

wherein in the variable speed reproduction in- 
formation, speeds for variable speed reproduction 
are associated with information specifying the pic- 
tures to be reproduced at said speeds respectively, 
and 

in the decoding step, the pictures to be repro- 
duced at instructed speeds are specified based on 
said instructed speeds and the variable speed re- 
production information. 

14. The moving picture decoding method according to 
Claim 13, 

wherein in the variable speed reproduction in- 
formation, the speeds at which the pictures need to 
be decoded are described respectively according 
to picture numbers of said pictures. 

15. The moving picture decoding method according to 
Claim 13, 

wherein in the variable speed reproduction in- 
formation, speeds at which the pictures need to be 
decoded are described respectively in sequence. 

16. The moving picture decoding method according to 
Claim 13, 

wherein in the variable speed reproduction in- 
formation, picture numbers of pictures necessary 
for the reproduction at the speeds are described for 
each of said speeds. 

17. The moving picture decoding method according to 
Claim 11, 

wherein the variable speed reproduction in- 



formation is an index specifying a corresponding 
reference relationship in a list of predetermined ref- 
erence relationships, and 

in the decoding step, the corresponding refer- 
5 ence relationship is specified in the list of predeter- 

mined reference relationships based on the index. 

18. The moving picture decoding method according to 
Claim 17, 

10 wherein the list of predetermined reference 

relationships is a map table having a plurality of sets 
of map information in which speeds for variable 
speed reproduction are associated with information 
specifying the pictures to be reproduced at said 
15 speeds respectively. 

the index is an identifier for selecting corre- 
sponding map information in the map table, and 

in the decoding step, the pictures to be repro- 
duced at instructed speeds are specified based on 
20 said instructed speeds, the map table and the iden- 
tifier. 

19. The moving picture decoding method according to 
Claim 18, 

25 wherein in the information extraction step, the 

map table is extracted, and 

in the decoding step, the map table is decod- 
ed. 

30 20. The moving picture decoding method according to 
Claim 11 , 

furthercomprising a memory control step of control- 
ling a picture on the assumption that the picture is 
stored in a picture memory when the reproduction 
35 is performed at variable speed, said picture being 
not to be reproduced at variable speed but referred 
to by another picture. 

21. A moving picture coding apparatus for coding a 
40 moving picture signal on a picture-by-picture basis 

and generating a bit stream, comprising: 

an information creation unit operable to create 
variable speed reproduction information for 
45 specifying pictures to be reproduced at variable 

speed; and 

a coding unit operable to code the variable 
speed reproduction information and adding 
said information to the bit stream. 

50 

22. A moving picture decoding apparatus for decoding 
a bit stream on a picture- by- picture basis, compris- 
ing: 

55 an information extraction unit operable to ex- 

tract variable speed reproduction information 
for specifying pictures to be reproduced at var- 
iable speed; and 
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a decoding step operable to decode the varia- 
ble speed reproduction information and speci- 
fying and decoding the pictures to be repro- 
duced at variable speed based on the variable 
speed reproduction information. 5 



23. A program for coding a moving picture signal on a 
picture-by-picture basis and generating a bit 
stream, the program causing a computer to exe- 
cute: 10 



an information creation step of creating varia- 
ble speed reproduction information for specify- 
ing pictures to be reproduced at variable speed; 
and 15 
a coding step of coding the variable speed re- 
production information and adding said infor- 
mation to the bit stream. 



24. A program for decoding a bit stream on a picture- 20 
by-picture basis, the program causing a computer 
to execute: 



an information extraction step of extracting var- 
iable speed reproduction information for spec- 25 
ifying pictures to be reproduced at variable 
speed; and 

a decoding step of decoding the variable speed 
reproduction information and specifying and 
decoding the pictures to be reproduced at var- 30 
iable speed based on the variable speed repro- 
duction information. 



25. A bit stream that is generated by coding a moving 
picture signal on a picture-by-picture basis, com- 35 
prising variable speed reproduction information for 
specifying pictures to be reproduced at variable 
speed. 
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